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Strong Divergence for System Approximations 

Holger Boche and Ullrich J. Monich 


Abstract 

In this paper we analyze the approximation of stable linear time-invariant systems, like the Hilbert 
transform, by sampling series for bandlimited functions in the Paley-Wiener space VW\. It is known that 
there exist systems and functions such that the approximation process is weakly divergent, i.e., divergent 
for certain subsequences. Here we strengthen this result by proving strong divergence, i.e., divergence 
for all subsequences. Further, in case of divergence, we give the divergence speed. We consider sampling 
at Nyquist rate as well as oversampling with adaptive choice of the kernel. Finally, connections between 
strong divergence and the Banach-Steinhaus theorem, which is not powerful enough to prove strong 
divergence, are discussed. 


Index Terms 

strong divergence, bandlimited signal, Paley-Wiener space, linear time-invariant system, Banach- 
Steinhaus theorem 


I. Introduction 

Sampling theory studies the reconstruction of a function in terms of its samples. In addition to its 
mathematical significance, sampling theory plays a fundamental role in modern signal and information 
processing because it is the basis for today’s digital world lf37l . 

The fundamental initial result of the theory states that the Shannon sampling series 

X f(k' S[n<y7T<yt ~ ^ 

k =—oo 


7r(f — k) 
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can be used to reconstruct bandlimited functions / with finite L 2 -norm from their samples {/(AOlfcez- 
Since this initial result, many different sampling theorems have been developed, and determining the 
function classes for which the theorems hold and the mode of convergence now constitute an entire area 
of research J33[, j27j|, 021, 153- 

In this paper we study the convergence behavior of different sampling series for the Paley-Wiener 
space VW\ consisting of absolutely integrable bandlimited functions. Analyzing sampling series and 
finding sampling theorems for the Paley-Wiener space VW\ has a long tradition lfl3l . fT6l . lfl7l . Since 
Shannon’s initial result for PWj |f37l , efforts have been made to extend it to larger signal spaces 8T3l . 

& H3- 

In this paper we prove strong divergence, i.e., divergence for all subsequences, for different sampling 
series, where only weak divergence, i.e., divergence for certain subsequences, was known before, and 
further, we give the order of divergence. We also study the approximation of linear time-invariant (LTI) 
systems and show that we have strong divergence there, even in the case of oversampling. Interestingly, 
it is possible to show strong divergence if the system is the Hilbert transform, which is a stable LTI 
system for VW\, i.e. the space under consideration. 

In addition to the specific questions about the convergence and divergence behavior of sampling series, 
there also rises a general mathematical question in the context of the analyses in this paper: can we 
develop universal mathematical techniques for the convergence and divergence analysis of adaptive signal 
processing procedures? For example, the Banach-Steinhaus theory from functional analysis can be seen 
as a mathematical tool for analyzing non-adaptive signal processing procedures. The question is whether 
a similar theory can also be developed for adaptive signal processing. 

In the next section we will introduce some notation and then, in Section [Till we will give a more 
detailed motivation of the problem. 


II. Notation 

Let / denote the Fourier transform of a function /, where f is to be understood in the distributional 
sense. By L P (M), 1 < p < oo, we denote the usual L p -spaces, equipped with the norm || • || p . 

For a > 0 let B a be the set of all entire functions / with the property that for all e > 0 there exists a 
constant (7(e) with \f(z)\ < (7(e)exp((<T + e)|^|) for all z £ C. The Bernstein space £>? consists of all 
functions in B a whose restriction to the real line is in L P (M), 1 < p < oo. A function in £>? is called 
bandlimited to er. 
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For a > 0 and 1 < p < oo, we denote by VW P the Paley-Wiener space of functions / with a 
representation f(z ) = 1/(27r) g(u) e lzw dot, z G C, for some g G L p [—a,o], If / G VW P , then 

g(cc) = /(tc). The norm for VW P , 1 < p < oo, is given by ||/||-pyy;p = (l/(27r) J/ T (T |/(tc)| p d u) l / p . 

III. Problem Formulation and Discussion 
A. Adaptive Function Reconstruction 

Before we state our main results, we present, motivate, and discuss the problems and main questions 
that we treat in this paper. Let 

(2) 

denote the finite Shannon sampling series. It is well-known that Sjyf converges locally uniformly to / 
for all functions / G VW\ as N tends to infinity fl3l . lfl6l . fl7l . However, the series is not globally 
uniformly convergent. The quantity 

P N f := max | f(t) - ( S N f)(t)\, 

i.e., the peak value of the reconstruction error, diverges for certain / G 'PVV’i as N tends to infinity. In 
ll8l it has been shown that there exists a function / G VW\ such that 

limsup -P/v/ = oo. (3) 

N^-oo 

Since the uniform boundedness theorem has been applied in the proof of ©• it follows immediately that 
the set of functions V C VW\, for which © holds, is a residual set. 

However, the divergence is only given in terms of the limsup. In a sense this is a weak notion of 
divergence, because it merely guarantees the existence of a subsequence { N n } nG [:( of the natural numbers 

such that liin r( _>oo PN n f = oo for a certain / G I). This leaves the possibility that there is a different 

subsequence { N *} ne ^ such that linin^oo -P/v* / = 0. 

This possibility was discussed in lH2l . and two conceivable situations were phrased in two questions. 
Question Ql: 

Does there, for every / G PWj, exist a subsequence {-/V n } ng N = {-ZVn(/)} ng N of the natural numbers 
such that sup neN P]y n f < oo? 

Question Q2: 

Does there exist a subsequence {iV n } ng j^ of the natural numbers such that sup neN P/v„/ < oo for all 

/ € VWl ? 
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Note that the subsequence {iV n (/)} ng N in Question Q1 can depend on the function / that shall be 
reconstructed. Thus, the reconstruction process £#„(/) is adapted to the function /. The problem of 
finding an index sequence, depending on the function /, that is suitable for achieving the desired goal, is 
the task of adaptive signal processing. In our case it is the adaptive reconstruction of / from measurement 
values. Adaptive signal processing covers most of the practical important applications. 

In contrast, the subsequence {N n } n£ ^ in Question Q2 is universal in the sense that it does not depend 
on /. Obviously, a positive answer to Question Q2 implies a positive answer to Question Ql. 

This brings us to the notion of strong divergence. We say that a sequence { a n } n eM C R diverges 
strongly if lim n _ ) . 0O |a n | = oo. Clearly this is a stronger statement than limsup,,^ 00 |a n j = oo, because 
in case of strong divergence we have lim n _ ) . 00 |ajv n | = oo for all subsequences { N n } n sN of the natural 
numbers. 

So, if P N f is strongly divergent for all / e VW\, then Question Ql and consequently Question Q2 
have to be answered in the negative. 

Divergence results as in © are usually proved by using the uniform boundedness principle, which is 
also known as Banach-Steinhaus theorem f2|. As an immediate consequence, the obtained divergence 
is in terms of the lim sup and not a statement about strong divergence. However, the strength of the 
uniform boundedness principle is that the divergence statement holds not only for a single function but 
immediately for a large set of functions: the set of all functions for which we have divergence is a residual 
set. 

Since the publication of Banach and Steinhaus CJ, lUJ, the Banach-Steinhaus theory has been developed 
further and has today become an important part of functional analysis. There also have been efforts to 
extend the Banach-Steinhaus theory into different directions ll38l . lfT8l . | jT9l , HOI . 021 . However, these 
extensions do not cover Question Ql, that is, they provide no tools to analyze adaptive signal processing 
techniques in the sense of Question Ql. Next, we will further discuss Question Ql and the difference to 
the Banach-Steinhaus theory. 

It is tempting to try to use the uniform boundedness principle to prove that the answer to Question 
Ql is no. Let N = {N n } ne jj be a subsequence of the natural numbers. Then the uniform boundedness 
principle states the existence of a residual set V{N) C VW ] n such that 

lim sup P Nn f = oo 

n—>oo 
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for all / e 'D(N). If we could prove that 

n w+ 0 ’ 

AT is a subsequence of N 

then the answer to Question Q1 would be no. However, the set of all subsequences of N contains 
uncountably many elements, and the uncountable intersection of residuals set may be empty. Hence, we 
cannot use this approach to prove strong divergence. In Section IVTTT-A I we will see an example where 
we have this situation. 

In 0 it has been proved, using a different proof technique, that there exists a function / e VW\ such 
that Pat/ diverges strongly, i.e., that lirri/v^oo Pv/ = oo. Hence, neither Question Q1 nor Question Q2 
can be answered in the affirmative for the Shannon sampling series. Moreover in 0, the authors posed 
a question about the divergence speed of P/v/ that we will answer in Section HVl 

It is interesting to note that the application of the uniform boundedness principle does not require a 
deep analysis of the approximation process S^f- A simple evaluation of the operator norm 

11 ^JV11 = sup ||SW/||oo 

f£PWl, 

ll/ll'PWl = 1 

is sufficient. 

It would be desirable to have a theorem, analogous to the uniform boundedness theorem, that can be 
used to prove strong divergences. Currently, little is known about the structure of this problem, and it 
is unclear whether such a theorem can exist 0, ROl . If32l . Due to the lack of such a theory, we need 
to develop proof strategies which are tailored to the specific situation of the different approximation 
processes in order to show strong divergence. 

After publication of 0, the first author noticed that Paul Erdos analyzed similar questions for the 
Lagrange interpolation on Chebyshev nodes |2T1 . However, in lf22l Erdos observed that his own proof 
was erroneous, and he was not able to present a correct proof. It seems that the original problem is still 
open. 

R. System Approximation 

A more general problem than the reconstruction problem, where the goal is to reconstruct a bandlimited 
functions / from its samples {/(£:)}fcez> is the system approximation problem, where the goal is to 
approximate the output Tf of a stable LTI system T from the samples {/(/<:)}A:ez of the input function 
/. This is the situation that is encountered in digital signal processing applications, where the interest 
is not in the reconstruction of a signal, but rather in the implementation of a system, i.e, the interest is 
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in some transformation Tf of the sampled input signal /. For discussions of the significance of signal 
processing as the basis of our digital information age, see for example |j9j] and references therein. 

We briefly review some basic definitions and facts about stable linear time-invariant (LTI) systems. 

A linear system T : VW 1 ^ —» VW?, 1 < p < oo, is called stable if the operator T is bounded, i.e., 
if ||T|| = sup mvwP<1 \\Tf\\ VVV p < oo. Furthermore, it is called time-invariant if (T/(- — a))(f) = 
(: Tf)(t — a) for all / E 'PWii and f, a E R. For every stable LTI system T : 'PW’i -» VW\, there exists 
exactly one function fly E L°°[— 7r, 7r] such that 

(Tf)(t) = ~^f /(c o)kr(oj)e iut dw, t € R, (4) 

for all / € VW\ 0. Conversely, every function hr E L°°[—7r,7r] defines a stable LTI system T : 
VW\ -A The operator norm of a stable LTI system T is given by ||T|| = Furthermore, 

it can be shown that the representation © with hr E L°°[— is also valid for all stable LTI systems 
T : VWl —> TWj. Therefore, every stable LTI system that maps VW\ in VW\ maps VW^ in PWj, 
and vice versa. Note that hr E L°°[— 7r,7 t] C L 2 [—tt,tt], and consequently h t E VW 2 . 

Similar to the Shannon sampling series (0Q), which was used in the function reconstruction problem, 
we can use the approximation process 

OO 

^ f(k)h T {t - k) (5) 

k=— oo 

in the system approximation problem. In order to analyze the convergence behavior of ©, we introduce 
the abbreviation 

N 

(T N f)(t):= f(k)h T (t-k). (6) 

k=—N 

As already mentioned before, for certain functions in / E VW\, the peak value of the reconstruction 
process HSW/Hoo diverges strongly as N tends to infinity. However, in the case of oversampling, i.e., 
the case where the sampling rate is higher than Nyquist rate, the function reconstruction process ,S'.v/ 
converges globally uniformly (4j. This is a situation where oversampling helps improve the convergence 
behavior, consistent with engineering intuition. In contrast, the convergence behavior of the system 
approximation process © does not improve with oversampling 0: for every tEl and every a E (0, vr] 
there exist stable LTI systems T: —> VW\ and functions / E PW* such that 

limsupl (Tf)(t) - ( T N f)(t)\ = oo. 

TV—>-oo 

In this paper we want to refine the Questions Q1 and Q2 and analyze five questions: 

1) Do we have the same strong divergence for the system approximation process Tjv/? 
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2) Is it possible to obtain quantitative results about the divergence speed? 

3) What happens in the case of oversampling? 

4) What are the cases where no strong divergence can occur, and how can they be characterized? 

5) How large is the set of functions with strong divergence? 

We will treat the fifth question only briefly in Section IVIII1 where we present one example where the 
set of functions with strong divergence is empty and two examples where this set is a residual set. In 
general, the answer to this question is unknown. 

IV. Behavior of the Conjugated Shannon Sampling Series and the Shannon Sampling 


Series 


In this section we analyze the behavior of conjugated Shannon sampling series and the Shannon 
sampling series. We first study the conjugated Shannon sampling series with critical sampling at Nyquist 
rate, i.e., the case without oversampling, and show that the answer to Question Q1 is negative in this 
case. To this end, let Swf denote the finite Shannon sampling series as defined in ©, and 



the conjugated finite Shannon sampling series. H denotes the Hilbert transform which is defined as the 
principal value integral 



The Hilbert transform is of enormous practical significance and plays a central role in the analysis of 


signal properties lf24l . lf34l . l39l . l25l . I i30l . ll29l . OTil . For further applications, see for example lt36l and 
references therein. 

It is well-known that H^f converges locally uniformly to H f as N tends to infinity, that is, for r > 0 
we have 



The next theorem gives an answer about the global behavior of ([7). 


Theorem 1. Let {ctv} AeN be an arbitrary sequence of positive numbers converging to zero. There exists 
a function fi € VW\ such that 
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1 


N 


lim --— 7 - 7 - | mm 

jv-ioo 6n log(AV) \ teR 


AW 


\k=—N 


1 — cos(-7r(t — k)) 
7T (f — fc) 


= —00. 


Proof: Let {e/v}iveN be an arbitrary sequence of positive numbers converging to zero, and e/y = 
max at > n (-M, N E N. Note that e/v > f for all iV E N. Further, let {AY }/,‘PN be a strictly monotonically 
increasing sequence of natural numbers, such that ejv fc > Yv fc+1 , k E N. We set dp. = — -\/(-N k+1 , 

k E N. It follows that dp. > 0 for all k E N and that 


y, ^ = v e w < °°- 

fc=i 


(8) 


For iV E N we define the functions 


, . ...sinWf-l)) 


t E 


where w/v(/c) is given by 

1 , |fc| <ay 

«w(*0 = 1 - JV < |fc| < 2N, 

0 , \k\ > 2 N. 

Note that we have wpy E and Htnivllpw 1 < 3 for all N E N (5j. Based on wn we define function 


A - ^S k w Nk+1 . 


(9) 


fc=i 


Since ||5fetnjv fc+1 ll-pw 1 < dr)/, and because of d8]l, it follows that the partial sums of the series in © form 
a Cauchy sequence in PW|, and thus the series in © converges in the "PW^-norm and consequently 
uniformly on R. Let N E N be arbitrary but fixed. For tpy = N + 1, it follows that 


N 


f fn — cos ( 7r (^Jv — 0) f m 1 — ( — 1 ) JV+1 1 

22 AW- 377 — 7 A-= 2^ A(0- 


7r(fAr - /) 


«=-Ar v ” ' l=—N 

There exists exactly one A: E N such that N E [N^, JV^ +1 ). We have 

1 00 

JHL 

l=—N 


ir(N + 1 — Z) ' 


( 10 ) 


iv 


E /i(o- 


7r(JV + l-0 


Af \ " /A 1 ~ (~1) 


1V+1-I 


fc=l i=—N 
N 


> ^ m 1 “ (~1) JV+1 1 

-2^~ u>N h+1 (iy 
k=k i=-n 


N + l-l 


N 


1 — ( — l)^" 1 " 1 1 

2 ^ K 2 ^ tv + 1 - i 
k=k i=-n 


(ii) 
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where we used that WN k+1 (l) = 1 for all k > k and all |/| < N. Further, we have 

N / -■ \N+l-l 00 2N+1 


Vfc+1 

oo 


\ ^ y- 1 ~ (~1) 

it iV d- 1 — / 

k=k l=~N 


1-(-!)' 


I 


? 

k=k l ^ 
oo AT 

^E^E^Tf! 




> 


1 00 
- log (2 A 7 + 3) V 4 

7T 


k=k 


= — log(2iV + 3)y^e/v^ 

> — 6jV log(-/V) p= 

7T V £Ar 


because N > Nj, and thus y/ejvT > y^e/v^" > y / F/v- From (fT0l) - (fT2l) . we see that 


N 


E /i(0 


l=—N 

for all iV € N, which in turn implies that 

1 ( 


1 — cos(7r(f n — l)) 1 , 1 

- KN n ” > -e N log iV —= 

ir{t N -l) n 


N 


lim 


max 


N—yoo e/v log(iV) l teR 


E /.w 1 ' CM<,( *r t)) m=oo. 


\k=—N 


ir(t — k ) 


( 12 ) 


The second assertion 

1 ( ( N i 

lim -- —min > fi(k)~ 

N-yoo ejv log(AT) yeR 

is proved by choosing fy = — N — 1 instead of fjv = -ZV + 1. ■ 

Next, we analyze the oversampling case for the conjugated Shannon sampling series, i.e., we treat 
question 3 from Section I1U-BI 

For the Shannon sampling series the convergence behavior in the case of oversampling is clear: we 
have global uniform convergence 0]. However, this is not true for the conjugated Shannon sampling 
series as the next theorem shows. 


— cos(7r(f — A;)) \ \ 

vr(t - k) )) = ~°° 


Theorem 2. Let {eer r be an arbitrary sequence of positive numbers converging to zero. For every 


o £ (0,7r] there exists a function f a € such that 

/ / N 


1 


lim --——— max 

N—yoo ejv log(-ZV) 1 teR 


E aw 


\k=—N 


1 — cos(7r(f — k)) 
TT (t — k ) 


= oo 


and 


N 


lim 


mil ---—— 

IV-Ioo €n log(iV) 


min 

teR 


E aw 

\k=—N 


1 — cos(-7r(f — k)] 
n(t — k ) 


—oo. 
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Theorem [2] shows that in the case of oversampling, we have the same divergence behavior and speed 
that was observed in Theorem [0 i.e, the case without oversampling. That is, if we use oversampling as 
in Theorem [2j we have no improvement. Of course, due to oversampling, we have the freedom to use 
better, faster decaying kernels than those in Theorem [2] We will analyze this situation in Section lYl 
Proof: Let cr £ (0, vr] be arbitrary but fixed. Further, let {ejvjiVeN be an arbitrary sequence of positive 
numbers converging to zero, and e/v = rna xm>n£m, N £ N. Let {N k }keN be a strictly monotonically 
increasing sequence of natural numbers, such that ejv fc > ejv fc+1 , k € N. We set 5 k = y/^N k — s/CN k+1 , 
k € N. For the proof we use the function fi from Theorem |T] which is defined in ©. Let 


and 


Since 


AM 


Am, 

o, 


r a M 





AM, 


w Nk+1 M = 2 K. 


2Wk + l 


M < cr, 

a < |w| < 7T 

M| < a, 

cr < M| < 7T. 

(w) — Kx k+i (u), 


where K^(uj) denotes the Fejer kernel 

K ¥ n (w) = 

we see that, for u € [—7r, —a] U [cr, 7r], we have 


1 sin 2 (^j 
JV si„ 2 (|) ’ 


Further, since 


\5 k w Nk+1 (u)\ < 


3 5 k 

N k+ i sin 2 (f)' 


OO 


E 


3 5 k 

N k+ i sin 2 (|) 


< oo, 


it follows that 

OO 

Y, $kWN k+ 1 

k =1 


converges uniformly on [— ir, —cr] U [cr, 7r], and hence defines a continuous limit function g on [— tt, —a] U 
[cr, 7r]. It follows that g € L 2 ([—7r, — cr] U [cr, 7r]). We already know from the proof of Theorem [I] that 


lim 

N^-OO 


h(w)~Y, SkU>N k+1 M 

k =1 


du = 0. 


(13) 
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Thus, we have 


' cr< |o;|<7r 


|/i(w) - g(u) I d UJ = 


' <T<|c«j|<7 r 


N 


= lim / 


AM- lim V 4wiv fc+1 (w) 

iV—>oo *—' 
fc=l 

N 

Am- S Sk'WNk+i (w) 


fc=l 


do; 


do; 


= 0, 


where we used Lebesgue’s dominated convergence theorem in the second to last and (fl3l ) in the last 
equality. This shows that fi = g almost everywhere on [— ir, — a] U [a, 7r]. Hence, using the definition 
of tv, we see that f a = f\ = g almost everywhere on [—7 r, —<r] U [cr,7r]. Since r CT (u;) = 0 for all 
u G (—cr, cr), it follows that f a G L 2 [—7r,7r], which in turn implies that r a G VYJ\. Knowing that 
r cr G TWj, it follows that 


N 


r ^ k ) 


1 — cos(7r(f — k)) 


k=—N 

for all N G N and t G R, which in turn implies 


7 r(f — fc) 


— Ir <r llpvv 2 


E /.w 1 — ( y> -E 


k=—N 

for all iV G N and t G R. It follows that 

/ /AT 


k=—N 


1 


max 


eTvlog(iV) y iGR 

1 


fv( k ) 


\k=—N 


N 


> 


max 


ejvlog(-ZV) \ tm 




7r(f — &) 

1 — cos( 7 r(f — fc)) \ \ 

7r(f - fc) J J 

1 — cos(7r(f — k)) 


— Fo-ll-pw 2 


\k=—N 


n(t — k ) 


- r, 


o-IIpw 2 


as well as 

--——— min fa(k)- 

ejvlog(iV) ^«=R 

< —-—7—rr ( min ( fi(k)- 

67V log (N) y tGR \ k ±^ N 

which, together with Theorem [H completes the proof. ■ 

Next, we come to the Shannon sampling series for the case of critical sampling at Nyquist rate. In 01 
it has been proved that there exists a function / G VW\ such that ||Sjv/||oo diverges strongly, i.e., that 
Umjv-Kx>||'Sjv/||oo = 00 , and thus shown that the answer to Question Q1 is negative. However, in 01 
the authors also raised a question regarding the divergence order. Using the function f\ from the proof 
of Theorem [TJ it is possible to answer this question. 


— cos(7r(f — k)) 
7t(£ — k) 


+ k 




— COs(7T (t — k)) 

ir(t — k) 
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Theorem 3. Let {e,v [.Veil be an arbitrary sequence of positive numbers converging to zero. There exists 
a function /2 € 'PW’i such that 



and 



Theorem [3] shows that for the Shannon sampling series it is possible to have strong divergence with 


order e^r log (TV) for all zero sequences cat. 

Proof: Let {e 7 v}A/eN be an arbitrary sequence of positive numbers converging to zero, and ejv = 
maxjvr>jv cm, N £ N. Let {Nk}ken be a strictly monotonically increasing sequence of natural numbers, 
such that €N k > L/v fc+ i> k € N. We set 5k = \ftN k — y/^N k+1 , k <£ N. For the proof we use the function f\ 
from Theorem[I] which is defined in ©. Let F\ (e luJ ) = fi(u), u £ [—it, it), and = F\ (eA £J + 7r )), 

cj £ M. We have F\ £ L 1 (dD) and consequently F 2 £ L 1 (dD), where L 1 (dD ) denotes the set of 
Lebesgue measurable functions F on the unit circle satisfying 



Further, let 



II follows lhat f 2 e VW\, 11/2ll?>vv’ — ll/lll-pw; < OO, and 
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For TV £ N, TV even, and tj\r = TV + 1/2 we have 

N . , ,, IXS N 


E / 2 W 


k=—N 


sm(ir(t]y — k)) 
n(t N - k ) 


S /2(fe) .(TV+I-fc) 


k=—N 
N 


1 


7T 


E (-0‘AW 


(-1)' 


k=—N 
N 


vr(TV + i - A:) 


/ E AW 1 


> 


1 


k=—N 

N 


TV 


E 


TV+i-fc 


1 

TV + f-fc’ 


k=—N 

because f\ (k) > 0 for all k £ Z. For TV £ N, TV odd, and = N + 3/2 we have 

N . / /, IS \ AT 


E /a(*) 


k=—N 


sin(7r (tjv — A:)) 
7r(Uv - A:) 


E AW- sin(7r(JV +1 ~ fc)) 


k=—N 
1 * 


tt(A1 + § - A:) 


- E (- 1 ) fc /i( fc ) 

7T Z ' 


(-i)‘ 


k=—N 

N 


n(N + i-k) 


E 


1 


k=—N 


TV + | — &;' 


Flence, we see from (fl4l) and (fl5l) that 


AT 


AT 


maxi E AW Sill / (t lf )) 1 >- E AW - i - 

,6 '' *(t-k) ) - 1; A- V JV + I-* 


7T (f — fc) 

for all TV £ N. Using the same calculation as in the proof of Theorem Q] it is shown that 

1 


N 


l E AW 

k=—N 

From (fl6l) and ( 1T71 ) it follows that 

1 


JV + I-A: 


> —cat log(TV)—E- 

7T y (-N 


N 


lim --—- max 

AT-Kso Cat log(TV) \ fGR 


E -fe(fc) 


sin(7r(f — A;)) 
ir(t — k ) 


= 00, 


(14) 


(15) 


(16) 


(17) 


\k=—N 

which proves the first assertion of the theorem. The second assertion is proved similarly by choosing 
fAt = TV + 3/2 instead of = TV + 1/2 in (fl4l) and +v = TV + 1/2 instead of tN = TV + 3/2 in (fl5T ). ■ 
In the next section we analyze the use of more general kernels. 


V. Oversampling with Kernels 

We now come back to the situation where we know the function / on an oversampling set. In Theorem[2] 
we already studied the oversampling case for the conjugated Shannon sampling series and observed that 
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mere oversampling with the standard kernel does not remove the divergence. However, the redundance 
introduced by oversampling allows us to use other, faster decaying kernels. This introduces a further 
degree of freedom that can be employed for adaptivity. In addition to the subsequence {iV n } neN , we 
now can also choose the reconstruction kernel dependently on the signal /. Thus, question Q1 can be 
extended in the case of oversampling to also include the adaptive choice of the kernel. We will show in 
this section that for any amount of oversampling the extended question Q1 has to be answered negatively. 
That is, even the joint optimization of the choice of the subsequence {W n } raGN and the reconstruction 
kernel cannot circumvent the divergence. 

We first consider the function reconstruction problem. In the oversampling case, it is possible to create 
absolutely convergent sampling series by using other kernels than the sine-kernel Ifl4l . |f20l , fThil . In 
particular, all kernels f in the set A4(a), which is defined next, can be used. 

Definition 1 . A4(a), a > 1, is the set of functions f G B x aix with f{u) = 1/a for |w| < it. 


The functions in A4(a), a > 1, are suitable kernels for the sampling series, because for all / G 'PWl 
and a > 1 we have 


lim max 

TV—>• oo 


N 


m- E / L 


if 4> G M(a). 

We introduce the abbreviation 


k=—N 


m,*/)(*):= E /(£) 


k 

t - 

a 


= 0 


k=—N 


Theorem 4. Let {e,v hvet i be an arbitrary sequence of positive n umbers converging to zero. There exists 
a universal function f\ G 'PVV’i such that for all a > 1 and for all (p G A 4(a) we have 

1 


lim —-——- max(H% = oo 

A^ooeArlog(iV) tm v 


and 


lim 

N —>oo e n J 


= -oo. 

Theorem [4] shows that it is possible to have strong divergence with order cat log (N) for all zero 
sequences en even in the case of oversampling. 

Remark 1. We have the following result. Let a > 1 be arbitrary. For every ^ G Af(a) there exists a 
constant Cj such that 

||^/||oo<C' 1 log(7V)||/|| pwi 
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<7i 


—an — 7r — 2 


1 



LU 


Fig. 1. Definition of q\ (solid line) and <72 (dashed line). 


for all iV > 2 and all / € 'PWl. It follows that 

Il^/lloo n 

lim —-7777— = 0. 

JV-> OO log(iV) 

This shows how sharp the result in Theorem [4] is. Note that the same result is also true for Theorems 

mm 

Remark 2. As already mentioned, Erdos analyzed the question of strong divergence for the Lagrange 
interpolation on Chebyshev nodes in OTl . There, for continuous functions, a similar log (A") upper bound, 
as in Remark Q] holds for the maximum norm of the Lagrange interpolation polynomials. The original 
problem that was formulated in ||2T1 is still open. However, an analysis of the behavior of Lagrange 
interpolation polynomials indicates that even if strong divergences occurs, a statement like in Theorem [3] 
about the log(A r ) divergence speed cannot hold, i.e., it is not possible to get arbitrarily “close” to 
log (AT) divergence. 

The proof of Theorem 0] uses some techniques and the following lemma from (6). 


Lemma 1. For all a > 1, / E VW\, N € N and |f| > (N + 1 )/a we have 

N 


E 

k=—N 




< a 


where 


r W := ^2 ( sin (7rt)-sm(|t)) 


Proof of Theorem [7} Let a > 1 be arbitrary but fixed. Lurthermore, let f and (p be the functions 
defined in Ligure [I] and f G J\4(a) some arbitrary reconstruction kernel. Then we have 


= f * Qi + <t> * 12 = qi + 4 > * <12 


and 


Hf = Hqi + H(4>* q 2 ) = Hq\ + f* ( Hq 2 ). 
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Since Hq^ G L 1 (M), it follows that s := <j>* (. Hq 2 ) G L 1 (M). Moreover, for iV G N and / G VW l n we 
have 


|(^/)(f)-(^ gi /)(f)| 

N 


k=—N 

N 


N 




k=—N 


k=—N 

N 

£ E 

k=—N 


— \\J Moo 


E 



/ jfe\ 

/ - 

s f- 

V ri 7 

V “/ 


E 


s f — 


k 


k =—oo 

< C'sII/IUIIsIIb^, (18) 

where we used Nikol’skii’s inequality 1281 p. 49] in the last step. For r/Owe can simplify (Hqi)(r), 
using integration by parts, according to 

(#<?i)( T ) = 2 “ f -«sgn(w)qi(w)e^ r dw 


1 


/*7T 

/ sin(uiT)<7i(u;) die 

Jo 


* 4 0 
= — -r(r), 


where 


r r := 


7TT 


7T 2 T 2 


7r 

Sin(7TT) — sin | — T 


For |t| > (iV + l)/a we thus obtain 


N 


m, q jm = E / 


and since 


k=—N 

N 


k\ 1 


Af 


“7 ’T (t - s) 


e/(!V(‘-! 


k=—N 


E / ;rr; 


k=—N 


< a 


by Lemma |TJ it follows that 


TV 


y /(-] - g 1 -» 2 iuiioo. 


k=—N 




(19) 
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Combining (fl8l) and ( fl9l ) we see that 


m,*m) > m, q jm-c 2 \\f\u\s\\ BL 

N 


> 


E f 

k=—N 


1 




— (a 2 + C2||s||jBi 


( 20 ) 


for all |i| > (N + 1 )/a and all / E VW Hence, it suffices to concentrate the analysis on 


N 


E/C 


k=—N 


1 


aj vr (t-|) 

in the following. 

Let {s .v} ,vew be an arbitrary sequence of positive numbers converging to zero, and e ; .y = maxM>iv f m, 
JVeN. Note that ejv > e: ; y foi' all A r E N. Further, let {Aq. }/.-£! ! be a strictly monotonically increasing 
sequence of natural numbers, such that e^ k > £N k+1 , k € N. We set 8k = y/^N k ~ y/£N k+1 , k E N. It 
follows that 5k > 0 for all k <E N and 


y, ^ = < oo. 

fc=l 


( 21 ) 


For M E N we consider the functions 


9Af(*) = 


sin (^f) 


AT 


t 


Note that |.//m ||-pvv' = 1 for all M € N. Let be a sequence of monotonically increasing natural 

numbers, such that gM k (t ) >1/2 for |t| < JVfe + i, k E N. We define the function 


/l = X] 


( 22 ) 


fc=i 


Since ll-pw 1 = and because of (f2Tb . it follows that the series in (1221) converges in the VW\- 

norm and consequently uniformly on M. 

Let N E N be arbitrary but fixed. There exists exactly one k E N such that N E [A/,, ). Since 

5k > 0 and gM k (t) > 0 for all t E M and all k E N, we have, for = (A/ + l)/a, that 


A/ 


E A 


l=—N 




TV oo 

a EE 5kgM k 

l =~ N k=k 
1 oo N 

CEi E 


° 7 7T I tVV - 


(!) _ l 
N a 


k=k 


=- N Tr[tN - £ 


where we used in the second inequality that 


gM k - > - 
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for all k > k and all / < N. It follows that 


N 


£/. 


l=—N 


N 


1 

k=k 


tt ( — L\ 2 ' 7 r (22hi — -) 

77 QTV a) k=k l=~N y a a> 


oo 27V+1 

is* £ 7 

k=k l ^ 


£ 27T 


k=k 


— 2^: l°g(2^V + 2)y / eAr7 

> ^ejvlog(iV)—=, 

2vr y £jv 


because A r > Aq. and thus y'ejvj £ V / A£ _ £ \/ejv- From (1231) we see that 


AT 


lim 


W—>oo Cat log(iV) 


£M 


I=-1V 


a/ v,- (A 1 ) _ I 

77 1 7 A a 


= OO. 


Thus, it follows from (l20l) that, for arbitrary a > 1 and cp € Ad (a), we have 

lim --— 7 -—max(H% rh fi)(t) = oo. 

TV^oo e A rlog(A 7 ) t€R v N ’ < I> J 7W 

,(2) _ 


Following the same line of reasoning it is shown that, for r N = —(N + 1 )/a, we have 


1 


N 


lim , T , 
A->oo Cat log(A') 


£a A 


E=-JV 


1 


a / tt (^ 2 ) _ 1 
77 1 % a 


= —OO, 


and consequently 


lim — 

A—>oo Cat 




(23) 


As explained in the introduction, it is interesting and also important for applications to analyze the 
general question when and why strong divergence occurs. We have already seen several cases in this 
paper where strong divergence emerged, however a general theory is missing. 

VI. Pointwise Convergence Behavior 

In Sections |IV| and [V] we analyzed the global behavior of the reconstruction and approximation 
processes. In this section we will study the pointwise behavior of the system approximation process 
for fixed t G M, i.e., the quantity of interest is (Xjv/)(i). We want to know if Question Q1 has to be 
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answered negatively in this case. It will turn out that the situation is different, and that Question Q1 has 
a positive answer for all stable LTI systems T and all t G R. 

Let := (Tjv/)(f). For t£Kwe consider 

\\T N ,t\\* : = su p \(T N fm\. 

ll/ll'PWl —1 

It is known that for every t E M there exists a stable LTI system T 1 : —> VW'l such that 

limsup||r^- t ||* = oo. 

N—>oo 

Therefore, there exists a function /i E VW\ such that 

limsup|(T^/i)(f)| = oo. (24) 

TV—>• oo 

This shows that for every t E M there exists a stable LTI system T 1 : VWl —> 'PVV’i and a function 
/i E PWi such that the system approximation process (Ty/i )(f) diverges weakly. 

Note that (l24l) is true not only for equidistant sampling as in ©, but also for any sampling pattern 
that is a complete interpolating sequence ll9l . 

The question whether (Tjv/)(f) also converges strongly for some stable LTI system T and function 
/ € VW\ is the topic of this section. It will turn out that strong divergence cannot occur in this case. 
Thus weak divergence does not automatically imply strong divergence. Hence, for the approximation 
process (T/v/)(f), we can answer Question Q1 positively. 

We first make a statement about the convergence of the Cesaro means 

M—X 

u E pwxo- < 25 ) 

N=0 

The following theorem shows that (1251) converges globally uniformly, and consequently for fixed t € K, 
to ( Tf)(t ) as M tends to infinity. 


Theorem 5. Let T: VW\ —> be a stable LTI system. For all f E we have 


lim max 

M—kx> t GR 




M—l 

mEwiw 

N =0 


= 0. 


Proof: Let T : VW\ —> VWl be a stable LTI system, arbitrary but fixed. For / E VWl, f E 1, 
and N E No = N U {0} we have 

N 

0 T N f)(t)= f(k)h T (t-k) 

k=-N 


1 

27T 


/ 7T I PTT 

/(u,)- / Ktm y. 
_7r ^ _7r 


k(uj— uji) 


duji dw 
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and it follows, for Me N, that 


1 


M—l 


M £ ew)M 


7V=0 


M—l / N 


■ y_,r ' /_7r 7V=0 \k=—N / 

= ^ f /Mt^; f h T (uii) e iuilt k m(u) - uii) dwi dw, 


where 


F _ 1 f sin (^f) 
a M — ~ 


M € N, 


M \ sin (f) ) ' 
denotes the Fejer kernel. We have K ¥ m (ui) > 0 for all ui e [—7r, 7 t] and 


— / Klfiu) dw = 1 


for all M e N. Since 


1 

27T 


/ 7T 

hr{L0i) i 

-7T 


,*wit 


-Km(w ~ w i) dwi 


~2tt \hT{u{)\K ¥ M {u - wi) dwi 


< ||r||—/ Km(u-u) t) dwi 


= IITI 


for all u; € [— 7r, vr] and all t e M, we see from (1261 that 


M—l 


s£( r M)(t) 


N=0 


< 


vwl 


for all / e £144 and all t e R. 

Let / e £W4 and e € (0, 1) be arbitrary but fixed. There exists a f e e £V\4 such that 

11/ “ fe\\vWl £ e - 

Further, since f e e 'PW’4 there exists a natural number iVo = jVo(e), such that 


(26) 


(27) 


max|( r /e )(4 - (Tiv/ e )(t)| < e 

ctM 


(28) 
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for all N > Nq. For M G N we have 


M—l 


(Tfm-±-j2(T N m) 


M 

N =0 

(T/)(*)-(T/ e )(t) + (T/ e )(t) 


M—l M—l 

jj E /.)(<) - „ E pm/ - /<))(*) 


N=0 


M 


N =0 


<|(T/)(i)-(T/ e )(i)| + 


M—l 




N=0 


+ 


M—l 


Epw -/,))(<) 


N=0 


< 11^1111/ ~ /ellpWi + 


M—l 


^ J2(Tf e )(t)-(T N f e )(t) 


N=0 


+ 11^1111/ — /J-pw 


(29) 


where we used (l27l) in the last inequality. For the second term on the right-hand side of (1291 ) we obtain, 


for M > No + 1, that 

M—l 

-j2(Tfem-(T N m) 

N=0 


N 0 -l 


M—l 


< 


g E K r / e )(t) - PV/,)(t)| + J7 E KT’/.KO - (Tv/«)(t)l 


M 

TVo 


N=0 


N=N 0 


M — Nn 

+-77—- max \(Tf e )(t) — (T/v/ e )(f)| 

M No<N<M—l ' J n V J ^ '' 

< —7 max max |(T/ e )(f) — (Tjv/ e )(f)| H——77—-e, 
_ M teR i<Af<Af 0 -i lv ^ n y J n M 


(30) 


where we used (1281) in the last inequality. We choose Mq > Nq + 1 large enough such that 


N 0 

—— max max 

7V/q 1<AT<AT 0 — 1 


|(T/ e )(f)-(T Ar / e ))(f)|<e. 


(31) 


From (l29l ). (f30l) . and (OTb it follows that 


for all M > Mq 


C Tf)(t) 


1 M—l 

m £ wx*) 

N=0 


< 2||T||e + e 


(32) 


Mo(e). Since the right-hand side of (l32l) is independent of t, the proof is complete. 
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Now we can answer the question from the beginning of this section whether we also have strong 
divergence for fixed t £ K in the system approximation case. 

Theorem 6. Let T : — >• VW\ be a stable LTI system, t £ K, and f £ VW\. There exists a 

monotonically increasing subsequence {N} : = Nk(t, /, T)}fe g pj of the natural numbers such that 

lim (T N J)(t) = ( Tf)(t ). 

k — yoo 

Theorem [6] immediately implies the following corollary about strong divergence. 


Corollary 1 . For fixed t £ M, all stable LTI systems T : VW\ —¥ VW\, and all f € 'PVv'l strong 
divergence of ( f)(t ) is not possible. 


Proof of Theorem [6} Let T : VW\ VW\ be a stable LTI systems, t £ M, and / £ TWj, all 
arbitrary but fixed. To simplify the presentation of the proof, we assume that / and hr are real valued. 
If this is not the case, the following calculations need to be done separately for the real and imaginary 
part. 

From Theorem [5] we already know that 

M—l 

-^Tczwxt) (33) 

N=0 

converges as M tends to infinity, and that the limit is (T/)(f). We distinguish two cases: first, the 
sequence {(T/v/)(t)} at g n converges itself, and second, {(Tat /)(f)}jvgN diverges. 

We begin with the first case. If {(Tjv/)(f)}jveN converges then it converges to the same limit as (l33l) . 
which is (T/)(f). In this case the proof is already finished. 

Now we treat the second case. We assume that {(T/v/)(t)}jvgN is divergent. Then there exist two 
extended real numbers a and A (a = — oo and A = oo are possible) such that 


liminf(Tjv/)(f) = a 
TV—>• oo 


and 


limsup(T/v/)(t) = A. 

N —>-oo 

Note that we have a < A due to the assumed divergence of {(Tv/)(f) } ne rj and the convergence of the 
Cesaro means (l33l ). 

Next, we show that 


a<(Tf)(t)<A. 


(34) 
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Ifa = — oo or i = oo then the corresponding inequality in (l34l) is trivially fulfilled. Hence, we only 
have to show (l34l) for a > —oo and A < oo. Let e > 0 be arbitrary. There exists a natural number 
Nq = N 0 (e ) such that 

(TnM) > a-e 

and 

(T N m) < A + e 

for all N > Nq. Thus, we have for M > Nq that 

M—l N 0 -l M—l 

jj E pv/)«) = tt E w E pwxo 

N=0 N=0 N=N 0 

N= 0 

and 

1 _ ^ 1 t Vp- l , , _ AT 

M E pwxo < Jj E wmm + +e) ' 

7V=0 Ar=0 

Taking the limit M —>• oo yields 

(a-e) < (Tf)(t) < (A + e). 

Since this relation is true for all e > 0, we have proved (l34l) . 

Further, we have 


(Tiv/Xf) - (T N -if)(t) = f{N)hr(t - N) + f(-N)h T (t + N ) 


which implies 


lim (T]\rf)(t) - (T N ^f)(t) = 0 

IV -Too 


by the Riemann-Lebesgue lemma lf26l p. 105]. 

Next, we show that for every L > 0 and fi > 0 there exists a natural number N with N > L, such 
that 


(Tfifm e [(Tf)(t) - 2(1, ( Tf)(t) + 24 


This shows that we can find a monotonically increasing sequence {A 7 .} e j j such that 


lim (Tfr f)(t) = (: Tf)(t ), 
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and thus completes the proof. Let y > 0 and L > 0 be arbitrary but fixed. We have to distinguish four 

cases: 1) a > — oo and A < oo, 2) a > — oo and A = oo, 3) a = — oo and A < oo, and 4) a = — oo and 
H = oo. 

We start with case 1). There exists a natural number N\ = N\ (ji) > L such that 

\(T N J)(t)-a\<^ 

and 

|(T A r/)(f)-(T iV _ 1 /)WI<f (35) 

for all N > N\. Further, there exists a natural number IV 2 > A r | such that 

\(T N J)(t)-A\<^. (36) 

Let R be the smallest natural number such that 


a + Ry > A. 


If R = 1, we have A — a<fj,, which implies that (T^r 1 /)( t) € [(T/)(f) — 2/u, (T/)(t) + 2^], and the proof 
is complete. Hence, we assume R> 2. For n G [0, N 2 — iVi] we analyze ( T^ 1+n f)(t ). Since we have (1351) 
and (l36l) . and R > 2, it follows that there exists at least one index n 1 = ni (A r i, /V 2 . //) G [l,iV 2 — IVi] 
such that 


(7jV!+ni/)(f) S (a + a + -p 


(37) 


We chose the smallest of these n\, if there exist more than one. If R = 2, we stop. If R > 3 we continue. 
Due to (|35T ). (I36l ). and (|37T ) there exists at least one index 77-2 = n2 ( N\ , N 2 , /r) G [ni, A^2 — iVi] such that 

(T Nl+n J)(t) G (a + -//,a + -/i • 


We chose the smallest 112, if there exist more than one. We continue this procedure until we have con¬ 
structed the numbers ni(JVi, N2, n), ri2{N\, IV2, /r), ..., (A r i. N2, n). Further, since a < < 

A, there exists exactly one natural number r* with 0 < r* < R such that 

. / 2r* — 1 2r* + 1 1 

(T/)(f) G (a +--- n, a + --— y. . 


It follows that 

\(T Nl +n r . f){t) - (Tf)(t)l < y, 


which completes the proof for case 1). 
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Next, we treat case 2). Here have — oo < (Tf )(t) < A. We choose an arbitrary finite number M such 
that M < ( Tf)(t ). It follows that M < (T f)(t ) < A. Let N\ be the smallest natural number such that 
N\ = Ni(fi) > L, 

(T N jm < m, 

and 

\(T N f)(t) - (T iV _ 1 /)(f)| < | 

for all N > N±. Now, we execute the same calculation as in case 1), where we replace a by a' = 
(T/Vi/X t). This completes case 2). Case 3) is done analogously to case 2). 

In case 4) we have a = — oo and A = oo. We choose two arbitrary finite numbers M\ and M2 such 
that Mi < (Tf)(t) < M2. Let N± be the smallest natural number such that N\ = N\ (//) > L, 

(T Nl f)(t) < Mi, 

and 

|(T J v/)(f)-(T iV _ 1 /)WI<f 

for all N > N\; and let N2 > N\ be the smallest natural number such that 

(T N jm < m 2 , 

and 

\(T N f)(t) - (Tjv-r/)^)! < | 

Now, we execute the same calculation as in case 1), where we replace a by a' = (T j /v 1 /)(f) and A by 
A' = (Tjv 2 /)(*). This completes case 4) and thus the whole proof. ■ 

Remark 3. The proof of Theorem [6] shows that in the case where (Tn f ){t) is divergent, there exists for 
every real number £ € [a, A] a monotonically increasing subsequence {A^. (C) }/.-ei J of the natural numbers 
such that 

ST r A<sT<*> = «■ 

VII. Behavior of the Threshold Operator 

The threshold operator, which is of importance in many applications, maps all values below some 
threshold to zero. If applied to the samples of the Shannon sampling series, the series becomes 

E (3« 
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In (l38l) . only samples that arc larger than or equal to the threshold S are considered. For / € VWl and 
fixed 5 > 0, the sum in (l38l) has only finitely many summands, because limiq^oo f{t) = 0, according to 
the lemma of Riemann-Lebesgue. 

Like for the Shannon sampling series S^f, where the truncation is done by considering only the 
samples f{k) where \k\ < N, the convergence behavior of Agf is of interest, as more and more samples 
are used in the sum, i.e., as 6 tends to zero. It has been shown that A$f is not globally uniformly 
convergent for VW\ in general. 

In this paper, we analyze the behavior of the Hilbert transform of (|38T ). which is given by 


(A s f)(t) := (HA s f)(t) = £ m 1 fff k)} , 


for functions / in VW\. 


Theorem 7. There exist a function f\ € PW^ such that 

limllAt/illoo = oo. 

<5->0 

Proof: We use the function f \ from the proof of Theorem |T] We have f\ (k) > 0 and f(k) = f(-k) 
for all k € Z, as well as fi(k) > f\ (k + 1) for k > 0 and f\(k — 1) < fi(k) for k < 0. Thus, for every 
5 with 0 < 6 < /i(0) there exists a natural number N = N(5) such that 

N(S) . ( 

t \n\ f tl \ 1 - cos(7r(f - k ) 

(As/.)(t)= L MV -fcj-• 

k=-N(8 ) v ’ 

Due to the properties of fi we have lim^^o N(6) = oo. This is a fixed subsequence. According to the 
strong divergence, we have divergence for every subsequence. ■ 


VIII. Discussion 

A. Divergence for Subsequences and Strong Divergence 
Next, we treat question 4 from Section IIII-RI 

It is possible to state an approximation process for the Hilbert transform for which the answer to 
Question Q2 is negative but the answer to Question Q1 is positive. For this approximation process, the 
question raised by Paul Erdos in ifTTll is to be answered negatively. 

Let / be a continuous 27r-periodic function and / := Hf the Hilbert transform of /. We only consider 
such / for which / is also continuous ITO . Equipped with the norm ||/||s = ||/||oo + ||/||oo> this space 
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is a Banach space, which we denote by B. We would like to approximate functions / e B by their finite 
Fourier series 


( U N f)(t ) := ^ + Yia k cos(Art) + sin(fcf)). 


AT 


k =1 


Then the Flilbert transform of U^f is given by 


AT 


( U N f)(t ) := sin(fcf) - b k cos(kt)). 


We have 


and 


fc=i 


1 


( U N f)(t ) = - / f{r)D N (t - r) dT 
J — TT 

(U N f)(t) = - f f(r)D N (t - t) dr, 

7T 


where TV denotes the Dirichlet kernel, and /Ty is given by 

= cos(|) -cos((iV + ^)f) 

sin(|) 

For details, see for example fl4ll p 59]. 

For every subsequence {Ay. }/, :G h there exists a function /] G B such that 


(39) 


(40) 


lim sup 

k—yoo 


(u Nk hm 


= oo. 


This follows directly from limjv_ >00 ||17jv,i|| = oo, where U^,tf '■= ( Uwf)(t ), and the uniform bound¬ 
edness theorem as discussed in Section Illl-AI Flowever, we do not have strong divergence in this case. 
Because of (l39l) and (l40l) we have Un f = Un f ■ Since / is also continuous, there exists, for every / in 
B and every t € [—7r,7r), a subsequence = {N k (f, i)}fcgN such that 


lim ( U Nk f)(t ) = /(f), 

K —^OO 

according to Fejer’s theorem j23l . 

This is an example where the set of functions for which we have weak divergence is a residual set, 
but where the set of functions for which we have strong divergence is empty, i.e., an example where the 
uncountable intersection of residual sets is empty. This possibility was discussed in Section IIII-AI 
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B. Strong Divergence for Residual Sets 


In the following we want to gain a better understanding of question 5 in Section I1I1-BI by giving two 
examples in which we have strong divergence for all functions from a residual set. It is important to 
note that the general behavior for strong divergence is unknown. In particular, it is unclear if for strong 
divergence we can have a similar situation as in the Banach-Steinhaus theorem, where weak divergence 
for one function implies weak divergence for all functions from a residual set. In order to obtain the 
results in this section we use very particular properties of harmonic functions. 

In the first example we consider the Hardy space H 2 and the quantity of interest is | f(r e ?,0J ) 

as r tends to 1. The space H 2 consists of all holomorphic functions / on the open unit disk D satisfying 

||/||^:= sup (^- [ \f{re^)\ 2 duj] < oo. 

0<r<l \^TT J-n J 

For 0 < r < 1 we define 


We have 


where 


M r (f):= max \f(re iUJ )\. 

—7T,7 r) 


11 M T 11 = sup M r (f) > <73(e) -r 11 , 


1<1 


n =1 


n 


C 3 (e) = 


OO 1 


E oo 
n= 1 


It follows that 


for all M e N, and consequently 


M 


liminf||M r || > 

r —^ I ^' 


n— 1 


n l/2+e 


lim||M r || = oo. 

r— 


Thus, the set of functions / € H 2 for which we have 


limsupM r (/) = oo (41) 

r —>1 

is a residual set V. Let f\ € H 2 be an arbitrary function satisfying (I4T1) . According to the maximum 
modulus principle, we have for 0 < rq < ?’2 < 1, that 

M r Ah) < M r Afl). 

Hence, we have lim r .^i M r (/i) = limsup r _ >1 M r (ff) = oo. This shows that we have strong divergence 
for all functions in the residual set V. 
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In the second example we consider the space C(dD) of continuous functions on dD, and the quantity 
of interest is max wg [_ jr 7 r )|(f/ e /)(e* a; )| as e tends to 0. H e is defined by 


1 


:= — 


/ (e * 1 


Let 


u(r,u) := 


7 e <| Wl -a»|< w tan( fiL ^ a -) 

i r 1 -r 2 

2n 


da,’ i. 


/(e^) r 


denote the Poisson integral and 


— 2 r cos(a; — oti) + r 2 

. , 1 f n . rsinfa; —on) 

^ J_J(e 1 ! — 2r cos(cd — uj,) + A 


da,’ i 


da,’ i 


max |(iT e /)(e“ J )| — max |n(l — e,u) 

CJG[—7T,7r) 7T,7r) 


the conjugate Poisson integral ED . There exists a constant C. 4 such that 

|(iT e /)(e-)-n(l-e,a;)|<C 74 ||/|| c(aD) 
for all / € C(dD), where ||/||c(aD) = max cje [_ 7 ri , r )|/(e“‘')|. Thus, it follows that 

< Ck\\f\\c(dD) 

for a universal constant C 4 . Let uj E [— n, ^ r) be fixed. Then the set of all functions / E C(dD) with 

limsup|n(r, a;) | =00 

r—>-1 

is a residual set ED- According to the maximum principle for harmonic functions, it follows that 

lim max \v(r, tu)| = 00 . (42) 

r—> 1 7T,7r) 

Since the set of function which satisfies (1421) is a residual set, it follows that the set of functions / E 
C(dD) with 

lim max | (HJ)(e luJ )\ = 00 

e—^0 7r,7r) 

is a residual set. 

Remark 4. 

1) For functions / in the Hardy space H 2 , which was discussed in the first example, the Poisson 
integral converges for r —» 1 in the L 2 -norm to the function /(e ia; ), a j E [—i.e., we have 

lim—/ k(r,o;)-/(e^)| 2 daj = 0 . 

27T J_ n 

The point evaluation operator of /, which maps H 2 to C and which is defined by / i-A /(e JaJ ), is 
unbounded (and only well-defined except for sets of Lebesgue measure equal to zero). 
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2) In the second example above, we discussed the Hilbert transform. For / E C(dD), the Hilbert 
transform Hf is defined as a L 2 -function. In general the Hilbert transform is not bounded, i.e., we 
have 

sup \\Hf\\ C (dD) = °o, 

||/||c(sd)<1 

/eC~(9D) 

where C°°{dD) denotes the set of infinitely often differentiable functions on dD. 

In both examples, the unboundedness of the operators enables us to show strong divergence on a residual 
set. In further studies flTOl . it became clear that the unboundedness of the operators is necessary to have 
strong divergence for a residual set. 

C. Final Remarks and Future Work 

We have shown that for the Shannon sampling series, the conjugated Shannon sampling series, and 
for more general system approximation processes based on equidistant sampling we can have strong 
divergence. Further, oversampling does not improve this behavior in general. This answers question 3 
from Section IIII-BI We have also shown that for pointwise system approximation, strong divergence 
cannot occur. 

For the approximation of the Hilbert transform of continuous 27r-periodic functions with continuous 
Hilbert transform the Question Q2 in Section IIII-AI has to be answered negatively and Question Q1 
positively. Moreover, for the Hilbert transform we can have strong divergence for a residual set. In all 
constructions and examples we use specific properties of the underlying function spaces and systems. 

It would be interesting to develop a general theory for strong divergence, in particular because such a 
theory can constitute the basis of an adaptive signal processing approach, as it was discussed in Sections 
HlFAl and ITlFBl 

Recently, a first step toward this general theory was made in iflOTl . As we already pointed out, the 
unboundedness of the operators in Section IVIU-BI is responsible for having strong divergence of the 
approximation processes on a residual set. In iflOl it was shown that for the approximation of bounded 
operators, strong divergence can occur at most on a meager set, and not on a residual set. The operators 
associated with the Shannon sampling series, the conjugated Shannon sampling series, and the system 
approximation process, i.e., the identity, the Hilbert transform and the LTI system under consideration, are 
bounded operators for the Paley-Wiener space VW\. Therefore, the divergence behavior from Sections 
HVl and m can on ly occur for functions from a meager set. 
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